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A method of generating an upsampled target pixel positioned 
between two lines of input source data includes the step of comparing 
pixels of different lines of the source data in a region surrounding 
the umpsampled target pixel to be generated in at least two different 
directions (50, 52, 54). An interpolation direction based on the 
comparison is selected (58) and interpolations between selected pixels 
of the source data in the determined interpolation direction are carried 
out to compute intermediate pixels on a line segment passing through 
the upsampled target pixel (60, 62). An interpolation between the 
intermediate pixels is carried out to generate the upsampled target pixel 
(64). An apparatus for performing the method is also disclosed. 
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METHOD AND APPARATUS FOR VIDEO SOURCE DATA INTERPOLATION 

TECHNICAL FIELD 

The present invention relates to data interpolation and in particular to 
a method of generating an upsampled target pixel from input source data and an 
apparatus for performing the method. 

BACKGROUND ART 

Video images can be represented as a two-dimensional array of 
digital data with each data point in the array representing a pixel of the digitized 
video image. The value assigned to each pixel determines its intensity and/or 
colour when the video image is recreated. In the video imaging art, it is often 
desired to magnify a video image to arbitrary magnification factors to create 
enlarged video images. When creating an enlarged image from an original image 
represented by a digital data array, it is necessary to interpolate between pixels of 
the original digital data array to generate upsampled pixels between consecutive 
lines and pixels of the original digital data array to "fill" in pixels of the enlarged 
image. Prior art techniques to create these enlarged video images have been 
considered. 

It is common practice in the prior art to use an orthogonal, Cartesian 
approach to interpolate separately the vertical and horizontal dimensions of the 
digitized video image to be enlarged. However, this technique typically results in 
enlarged video images which suffer from jagged edges commonly referred to as 
"stairstepping". Improvements in the interpolation method used may reduce the 
stairstepping, but it cannot be completely avoided because it is inherent when using 
this technique. 

A directional interpolation scheme addresses the stairstepping 
problem. Directional interpolation recognizes the geometric structure in images. 
With directional interpolation, it has been found that interpolation along the edges 
produces improved results over interpolation across the edges. Directional 
interpolation involves analysing local image structure and performing the 
interpolation based on the image structure. 
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U.S. Patent No. 5,019,903 to Dougall et al. discloses an apparatus 
for directionally interpolating between lines of a supersampled digital signal The 
apparatus calculates gradient vectors for use in directionally interpolating a 
vertically upsampled line. This operation makes the apparatus best suited for line- 
doubling deinterlacing applications. 

U.S. Patent No. 5,347,599 to Yaraashita et al. discloses an adaptive 
interpolation method and an apparatus using correlation detection. The apparatus 
performs calculations on lines of pixels of the source data to select the desired 
upsampling direction. However, similar to Dougall et al, this apparatus is also best 
suited for line-doubling deinterlacing applications. 

Although Dougall et al. and Yamashita et al. disclose alternative 
directional interpolation methods to generate upsampled pixels, their design is such 
as to support only fixed, integral vertical resize factors. Accordingly, there exists a 
need for an improved interpolation method and apparatus that supports arbitrary, 
fractional resize factors in both vertical and horizontal dimensions. 

It is therefore an object of the present invention to provide a novel 
method and apparatus for generating an upsampled target pixel from input source 
data. 

DISCLOSURE OF THE INVENTION 

The present invention performs directional interpolation to arbitrary, 
fractional resize factors. First, an interpolation direction is selected corresponding 
to any low-frequency edges in the source data. Next, directional interpolation is 
performed to generate intermediate pixels. The intermediate pixels are then 
interpolated, possibly non-orthogonally, to generated the desired upsampled pixel. 

More specifically, according to one aspect of the present invention 
there is provided a method of generating an upsampled target pixel from input 
source data comprising the steps of: 

(i) comparing pixels of different lines of said source data in a region 

surrounding an upsampled target pixel to be generated in at least two different 
directions; 
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(ii) selecting an interpolation direction based on the comparisons of step 

(0; 

(iii) interpolating between selected pixels of different lines of said source 
data in the interpolation direction determined at step (ii) and computing 
intermediate pixels on a line segment passing through said upsampled target pixel; 
and 

(iv) interpolating between the intermediate pixels to generate said 
upsampled target pixel. 

In the preferred embodiment, the line segment is parallel to the lines 
of the source data. Restricting the line segment to be horizontal as such, greatly 
simplifies the calculation of the intermediate pixels and the upsampled target pixel. 

In one possible embodiment, pixels of different lines of source data 
are compared in three different directions, including a vertical direction, and 
opposite oblique directions forming an angle with the vertical direction that is in 
the range 0<angle<90 0 . During the comparisons of step (i), difference values 
between the compared pixels are generated, the difference values being used to 
select the interpolation direction at step (ii). 

In this embodiment, prior to step (ii), the difference values resulting 
from the comparisons in the three directions are compared to determine whether the 
differences therebetween are within a threshold. The direction associated with the 
smallest difference value is selected as the interpolation direction when none of the 
differences are within the threshold. When the differences between the difference 
values resulting from the comparisons in all three directions are within the 
threshold, the vertical direction is selected as the interpolation direction. When the 
difference between the difference values resulting from the comparisons in the 
vertical direction and only one of the oblique directions is within the threshold, that 
oblique direction is selected as the interpolation direction. When the difference 
between the difference values resulting from the comparisons in the two oblique 
directions is within the threshold, additional pixels of the different lines of source 
data are compared in the opposite oblique directions. The difference values 
generated as a result of these comparisons are compared. When the difference 
between the difference values resulting from the comparisons of the additional 
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pixels is within the threshold, the vertical interpolation direction is selected as the 
interpolation directions. 

In another embodiment the line segment is once again parallel to the 
lines of the source data but this time pixels of the different lines of source data are 
compared in seven directions at step (i). These directions include the vertical 
direction and three pairs of opposite oblique directions forming varying angles with 
the vertical direction that are within the range 0°<angle<90°. Difference values 
between the compared pixels of step (i) are calculated. 

In this embodiment, the set of difference values to the left of the set 
under consideration and the set to the right are also examined. The three difference 
values for each possible oblique interpolation direction are summed and compared 
to determine if the differences therebetween are within a threshold. When none of 
the differences are sufficiently small to indicate a low-frequency edge in the source 
image, then the vertical direction is selected as the interpolation direction. When 
none of the differences are within the threshold, then the oblique direction 
associated with the smallest difference value is selected as the interpolation 
direction. When difference values associated with a "right- ward" oblique direction 
and a "left- ward" oblique direction are within the threshold, then the vertical 
direction is once again selected as the interpolation direction. Otherwise one of the 
oblique directions is selected as the interpolation direction. 

According to another aspect of the present invention there is 
provided an apparatus for generating an upsampled target pixel from input source 
data comprising: 

comparison means for comparing pixels of different lines of said 
source data in a region surrounding an upsampled target pixel to be generated, in at 
least two different directions; 

selection means for selecting an interpolation direction in response to 
said comparison means; and 

upsampling means for interpolating between selected pixels of 
different lines of said source data in the interpolation direction selected by said 
selection means to compute intermediate pixels on a line segment passing through 
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said upsampled target pixel and for interpolating between the intermediate pixels to 
generate said upsampled target pixel. 

The present invention provides advantages in that upsampled target 
pixels can be generated to allow large magnified images to be created with reduced 
stairstepping, particularly in the case of large magnification factors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Embodiments of the present invention will now be described more 
fully with reference to the accompanying drawings in which: 

Figure 1 is a diagram showing the pixels of three consecutive lines 
of video image source data, the position of an upsampled target pixel to be 
generated and the region surrounding pixels of the source data used to generate the 
upsampled target pixel; 

Figure 2 is a diagram showing the comparisons that are made 
between pixels of the source data in order to determine the interpolation direction 
to be used when generating an upsampled target pixel; 

Figure 3 is a diagram illustrating additional comparisons that are 
made between pixels of the source data when comparisons in two oblique 
directions yield similar values; 

Figure 4 is a diagram showing a vertical upsampling technique used 
to generate an upsampled target pixel; 

Figure 5 is a diagram showing a negative slope oblique upsampling 
technique used to generate an upsampled target pixel; 

Figure 6 is a diagram showing a positive slope oblique upsampling 
technique used to generate an upsampled target pixel; 

Figures 7a and 7b are flowcharts showing the steps performed in the 
first method when generating an upsampled target pixel from the source data; 

Figure 8 is a block diagram showing an apparatus for generating 
upsampled target pixels from input source data; 

Figure 9 is a schematic of a delay circuit forming part of the 
apparatus illustrated in Figure 8; 
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Figure 10 is a schematic of a decision circuit forming part of the 
apparatus illustrated in Figure 8; 

Figure 1 1 is a schematic of a p calculator forming part of the 
apparatus illustrated in Figure 8; 

Figure 12 is a schematic of an oblique upsampler forming part of the 
apparatus illustrated in Figure 8; 

Figure 1 3 is a diagram illustrating the comparisons between source 
pixels made in determining the interpolation direction for a second embodiment; 

Figure 1 4 is a diagram illustrating a boundary crossing situation; 

Figure 1 5 is a diagram showing a vertical upsampling technique used 
to generate an upsampled target pixel; 

Figure 16 is a diagram showing a positive 45° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figure 17 is a diagram showing a negative 45° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figure 1 8 is a diagram showing the source pixels used in a 26.6° 
slope oblique upsampling technique. 

Figure 19 is a diagram showing a positive 26.6° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figure 20 is a diagram showing a negative 26.6° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figure 21 is a diagram showing a positive 63,4° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figure 22 is a diagram showing a negative 63.4° slope oblique 
upsampling technique used to generate an upsampled target pixel; 

Figures 23a and 23b are flowcharts showing the steps performed in a 
second method when generating an upsampled target pixel from the source data; 

Figure 24 is a block diagram showing a second apparatus for 
generating upsampled target pixels from input source data; 

Figure 25 is a schematic of a delay circuit forming part of the 
apparatus illustrated in Figure 24; 
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Figure 26 is a schematic of a decision circuit forming part of the 
apparatus illustrated in Figure 24; 

Figure 27 is a schematic of a p calculator forming part of the 
apparatus illustrated in Figure 24; and 

Figure 28 is a schematic of an oblique upsampler forming part of the 
apparatus illustrated in Figure 24. 

BEST MODE FOR CARRYING OUT THE INVENTION 

When upsampling input video image digital source data to create an 
enlarged video image, it is necessary to generate upsampled target pixels between 
the lines and pixels of the digital source data. The resize factor and the resize 
direction (i.e. vertical and/or horizontal) determine the number as well as the 
position of the upsampled target pixels to be generated. 

In order to reduce stairstepping and create enlarged video images of 
high resolution, it is necessary to calculate accurately the values for the various 
upsampled target pixels to be generated. Thus, the upsampling interpolation 
direction used to generate the values of the upsampled target pixels should be 
selected to achieve this goal. Failure to select an upsampling interpolation 
direction which results in accurate values for the upsampled target pixels will result 
in the generation of enlarged images with noticeable stairstepping. 

The present method and apparatus generates an upsampled target 
pixel by calculating the difference in values of pixels of the digital source data in a 
region surrounding the upsampled target pixel to be generated in a number of 
directions. The calculated difference values are then examined in order to select an 
interpolation direction. Interpolations between selected pixels of the digital source 
data in the determined interpolation direction are then performed to generate 
intermediate pixels on a line segment that passes through the upsampled target 
pixel to be generated. Restricting the line segment to be parallel to the source data 
- that is, horizontal - simplifies the calculation of the intermediate pixels. 
Interpolations between the intermediate pixels are then performed to generate the 
upsampled target pixel. 
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An embodiment of the present method of generating an upsampled 



target pixel from input source data will now be described with particular reference 
to Figures 1 to 7b. 



pixel to the upsampled target pixel in the digital source data is determined and is 
used as a reference pixel P R in the interpolation method. The two consecutive lines 
of source data between which the upsampled target pixel is located are also 
determined. The reference pixel, the adjacent pixel on the same line of source data 
as the reference pixel P R and the two pixels on the other line of source data that 
form a rectangular region R surrounding the upsampled target pixel are determined 
(see block 50 in Figure 7a). The four source pixels that define the boundary of 
region R are used initially to determine the interpolation direction as will be 
described. The region R may correspond to any one of the four quadrants, namely 
top-left, top-right, bottom-left or bottom-right surrounding the reference pixel P R . 

Figure 1 shows a small segment of digital source data. The source 
pixels are labelled relative to the reference pixel P R = U w . The first line of source 
data is represented by five pixels U_,_ 2 to U. I2 , the second line of source is 
represented by pixels Uq. 2 to and the third line of source is represented by 
pixels U,. 2 to U, 2 . Clearly, pixel Uqo is the closest pixel to upsampled target pixel 
w and is the designated reference pixel P R . In this example, the upsampled target 
pixel w is positioned between the first and second lines in the top-left quadrant of 
region R. Pixels U_ M , U., 0 , IV, and Uqq are the pixels that define the region R 
surrounding the upsampled target pixel w and are used in the interpolation direction 
making decision. The following chart shows the pixels of the source data that 
define the region R in the four quadrants surrounding the reference pixel: 

Quadrant Pixels in Region R 



When an upsampled target pixel w is to be generated, the closest 



Top- Left 



Uoo, Uo_j, U.j.|, U. 



10 



Top-Right 



Uqo> Uqj, U.jj, U. 



10 



Bottom-Left 




U, 



10 



Bottom-Right 



10 
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Once the four pixels of region R have been determined, calculations 
are performed corresponding to three interpolation directions (see block 52). In the 
example of Figure 1, region R is defined by pixels: U. M , U l0 , U^, and Uoo and 
the following calculations are performed: 

Calculation Associated Interpolation Direction 

abs[Uoo-U M ] oblique 45° line up-left O l (1) 

abs[U 0 .,-U. 10 ] oblique 45° line up-right O r (2) 

absfUoo-U.u] vertical V (3) 

Figure 2 illustrates the interpolation directions O l , O r and V 
associated with the three calculations performed on pixels U.,.„ U l0 , U 0 ., and U^. 
Similar calculations apply for the other three quadrants. 

The calculation which yields the smallest difference value is usually 
associated with the interpolation direction which will yield an upsampled target 
pixel w having a value which is most similar to the values of the surrounding 
pixels of the source data. However before the interpolation direction is selected 
based on the results of these calculations, the calculated difference values are 
compared with each other to determine whether the differences are within a 
threshold of one another (see blocks 54 and 56). 

If one of the calculated difference values is clearly smaller than the 
other two values, the interpolation direction associated with the smallest calculated 
value is selected (block 58). If all three calculated difference values are within the 
threshold, the vertical interpolation direction V is selected (blocks 66 and 68). 

If the calculated difference value associated with the vertical 
interpolation direction V and the calculated difference value associated with only 
one of the oblique directions O l or Q< are within the threshold of one another, the 
oblique interpolation direction is selected (blocks 70 and 72). 

In the case where the calculated difference values associated with the 
two oblique interpolation directions 0 L and (\ are within the threshold of one 
another, it is important to select the proper interpolation direction since an incorrect 
decision will yield an enlarged image with noticeable discontinuities in diagonal 
lines. To assist in the selection process, calculations using additional pixels from 



'* 
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the same lines of source data are performed (block 74). Figure 3 shows these 
additional calculations for the example of Figures 1 and 2: 

Calculation Associated Interpolation Direction 

absfUoo-U,,] oblique 45° up-right 01 AR (4) 

5 abs[Uo_ r LU 2 ] oblique 45° up-left 01 AL (5) 

These additional calculated difference values are then compared to 
determine if they are within the threshold of one another (block 76). If one of 
these difference values is clearly smaller than the other, the oblique interpolation 
direction O l or associated with that calculated difference value is selected 
10 (block 58). However, if these two additional calculated difference values are 

within the threshold of one another, the additional following calculations using 
additional pixels from the same lines of source data are performed (block 78): 

Calculation Associated Interpolation Direction 

abs[Uo. 2 -U. M ] oblique 45° up-right 02 AR (6) 

15 abs[U or U. 10 ] oblique 45° up-left 02 AL (7) 

Similarly, these additional calculated difference values are compared 
to determine if they are within the threshold of one another (block 80). If one of 
these difference values is clearly smaller than the other, the oblique interpolation 
direction O l or associated with that calculated difference value is selected 

20 (block 58). However, if these two additional calculated difference values are 

within the threshold of one another, the vertical interpolation direction V is selected 
as a default to avoid the resolution problems which would occur if the incorrect 
oblique interpolation direction was selected (block 82). 

Once the interpolation direction is determined, selected pixels of the 

25 source data are determined based on the interpolation direction (block 60) and the 

interpolation direction is used to interpolate between the selected pixels of the 
source data to generate intermediate pixels v (block 62). The intermediate pixels 
are then interpolated horizontally to generate the upsampled target pixel w (block 
64). 
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Before the upsampled target pixel w can be generated, the location 
of the upsampled target pixel w must be determined. The upsampled target pixel w 
is defined by its distances from the reference pixel P R both in the vertical and 
horizontal directions. These distances are represented by the terms a y and a* 
where: 

-0.5 < a y £0.5; and 
-0.5 < a x £0.5; 

a y being positive downward and a x being positive to the right. The 
signs of a y and a* are related to the quadrant as follows: 

Quadrant a x a y 

Top-Left a x <0 a y <0 

Top-Right a x >0 a y <0 

Bottom-Left a x <0 a y >0 

Bottom-Right a, >0 a y >0 

With the values of a x and Oy known, interpolations are performed 
between the selected pixels of the source data in the determined interpolation 
direction. The resulting intermediate pixels v, are positioned on a horizontal line 
segment which passes through the upsampled target pixel w. In the present 
embodiment linear upsampling is described, however higher orders of interpolation 
can be used. 

Figure 4 shows an upsampled target pixel w positioned in the 
bottom-right quadrant. In this case, both a x and oty arc positive. The region R is 
defined by pixels Uoo, U 0I , U, 0 and U n and pixel Uqo defines the reference pixel 
P R . Intermediate pixels v 0 , v, and v 2 are also shown and have been computed 
using linear upsampling in the vertical direction. The intermediate pixels v 0 , v, and 
v 2 in this case are computed using the following equations: 

v 0 = (l-cc y )U ai + (8) 

v, = O-ogUoo + OyUo (9) 
v 2 = (l-a,)U 0J +0^, (10) 
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After the three upsampled intermediate pixels have been computed, 
interpolations are performed orthogonally horizontally between the two intermediate 
pixels on opposite sides of the upsampled target pixel w to determine the value of 
the upsampled target pixel. Therefore, before the upsampled target pixel w can be 
computed, it is necessary to determine which two intermediate pixels to select. In 
order to select the intermediate pixels, the term p is defined as the horizontal 
distance from the middle intermediate pixel v, to the upsampled target pixel w. 
The term p is positive to the right. For vertical interpolation, p = a x . The sign of 
p determines which two intermediate pixels surround the target pixel w. In the 
example of Figure 4, p ^0 so the interpolation is performed between v, and v 2 . 
The value of the upsampled target pixel w is computed using the following 
equation: 

w = (l-a>, + c^v 2 (11) 

In other quadrants, that is, cases for a y and o^, the intermediate 
pixels v and the upsampled target pixel w are calculated in a similar manner using 
different pixels of the source data that surround the reference pixel P R . 

When the oblique up-left interpolation direction O l is selected, the 
intermediate pixels v 0 , v, and v 2 are computed by interpolating linearly between 
selected pixels of the source data along negatively sloped diagonal lines. When 
linearly interpolating, the important parameter is the ratio of the distance of the 
interpolated pixel endpoints. Since the lines of source data and the horizontal line 
segment defined by the intermediate pixels are parallel, the intermediate pixels can 
be defined by a y , similar to the vertical upsampling case. 

Figure 5 shows the case of an upsampled target pixel w positioned in 
the bottom-right quadrant with a y and cc, once again positive. Region R is defined 
by pixels \J Wf U 0I , U I0 and U,, with pixel defining the reference pixel P R . 
Intermediate pixels v 0 , v, and v 2 are also shown and have been computed using 
oblique up-left interpolation. The intermediate pixels v 0 , v, and v 2 are computed 
using the following equations: 
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v 0 » + c^l^ 0 

v, = (l-a y )Uoo + <XyU u 

V 2 = (l-Oy)^, + OyV l2 



(12) 
(13) 
(14) 



After the three upsampled intermediate pixels have been computed, 
interpolations are performed non-orthogonally horizontally between the two 
intermediate pixels on opposite sides of the upsampled target pixel w to determine 
the value of the upsampled target pixel. In the example of Figure 5, since 
upsampling has been performed along 45° diagonal lines, the horizontal distance 
from intermediate pixel v, to reference pixel Uqq is the same as the vertical 
distance, namely a r Thus, the distance p from the upsampled target pixel w to the 
intermediate pixel v, is equal to a x - cCy . In fact this equation for p in oblique up- 
left upsampling is valid for all quadrants. P is negative in this case implying that 
the interpolation is between intermediate pixels v, and v 0 . Therefore, the value of 
the upsampled target pixel w is computed using the following equation: 

w = (l-(-P)) Vj + (-p)v 0 (15) 



In other quadrants, the intermediate pixels v and the upsampled 
target pixel w are calculated in a similar manner using different selected pixels of 
the source data that surround the reference pixel P R . 

When the oblique up-right interpolation direction O r is selected, the 
intermediate pixels v 0 , v, and v 2 are computed by interpolating linearly between 
selected pixels of the source data located along positively sloped diagonal lines in a 
similar manner to that described above with reference to Figure 5. 

Figure 6 shows an upsampled target pixel w positioned in the region 
R defined by pixels U,o, U 0I , U I0 and U,, with pixel U^, defining the reference 
pixel P R . Intermediate pixels v 0 , v, and v 2 are also shown and have been 
computed using oblique up-right interpolation. The intermediate pixels v 0 , v, and 
v 2 are computed using the following equations: 

v 0 = (l-cxy)!^, + o^. 2 (16) 

V, =(1-0^)1100 +OyU.) (17) 

v 2 = (l-a y )U 0l +c^U, 0 (1 8) 
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After the three upsampled intermediate pixels have been computed, 
interpolations are performed non-orthogonally horizontally between the two 
intermediate pixels on opposite sides of the upsampled target pixel w to determine 
the value of the upsampled target pixel. For oblique up-right upsampling it can be 
shown that p = a x + Oy. In the case of Figure 6, p is positive implying that the 
interpolation is between intermediate pixels v, and v 2 . The value of the upsampled 
target pixel w is computed using the following equation: 

w = (l-P)v, + pv 2 (19) 

In other quadrants, the intermediate pixels v and the upsampled 
target pixel w are calculated in a similar manner using different selected pixels of 
the source data that surround the reference pixel P R . 

The above-described method shows access to three lines of source 
data to demonstrate the cases for the four possible quadrants. It should be noted, 
however, that once the upsampling quadrant is known only two lines of source data 
are needed to perform the interpolations and generate the upsampled target pixel. 

Referring now to Figure 8, a source data interpolation apparatus for 
carrying out the above described method is shown and is generally indicated by 
reference numeral 100. The apparatus 100 receives a stream of input digital source 
data D in and interpolates between selected pixels U of the source data in order to 
generate upsampled target pixels w. 

The apparatus 100 includes a delay circuit 102 receiving the stream 
of source data. The delay circuit extracts the required pixels of the source data 
necessary to generate the desired upsampled target pixel w and passes the required 
pixels of source data to a decision circuit 104 as well as to an oblique upsampler 
106. The decision circuit 104 performs calculations numbered 1 to 3 and 4 to 7 on 
the pixels of source data if necessary and compares the calculated difference values 
with the threshold to determine the desired interpolation direction. The 
interpolation direction output of the decision circuit 1 04 is fed to the oblique 
upsampler 106 and to a p calculator 108. The output of the p calculator 108 is 
applied to the oblique upsampler 106 which uses the input data to generate the 
desired upsampled target pixel w. 
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Figure 9 better illustrates the delay circuit 102. As can be seen, the 
delay circuit has an input line 1 12 receiving the stream of input source data 
necessary to generate the desired upsampled target pixel w. The input line 
branches, with one branch 1 14 leading directly to three delay elements 120, 122 
and 124 connected in series. The other branch 116 leads to a line store 126, The 
output of the line store 126 leads to three delay elements 128, 130 and 132 
connected in series. The line store and the delay elements in each branch allow the 
delay circuit 102 to output four pixels from two consecutive lines of input source 
data simultaneously. For the case of interpolating in the bottom-right quadrant, 
with both <x x and Oy positive, the eight pixels extracted correspond to pixels 
Uo-»> U oo> U 0! , U 02 , U M f U, 0f U„, and U| 2 as shown. 

The decision circuit 1 04 is best seen in Figure 1 0 and has six input 
lines, each of which receives a selected pixel output by the delay circuit 102. The 
inputs are applied pairwise to subtracters 140, 146, and 150. The outputs of the 
subtracters are applied through delay elements 142, 144, 148, 152 and 154 to the 
selection logic 156 and represent the difference value results of calculations 
numbered 1 to 3 . The delay elements are necessary in order provide the difference 
value results corresponding to calculations numbered 4 to 7. Specifically, the 
output of subtracter 140, corresponds to 01 AR , a "future** value of O r . This value 
is applied to delay element 142 to give 0 R , which is then applied to delay element 
144 to give 02 AR . Likewise, the output of subtracter 150 corresponding to 0^ L , 
is applied to delay element 152 to give O l which is then applied to delay element 
154 to give 01 AL . To "equalize" the latency, delay element 148 is necessary to 
delay the output of subtracter 146. This value corresponds to V. All these values 
are passed to the selection logic 156. 

The selection logic 1 56 which receives the a, and Oy constants as 
well as the threshold value compares the calculated difference values to determine 
if any two or all three calculated values are within the threshold. In the cases 
where clearly one calculated difference value is the smallest, where the calculated 
difference value associated with the vertical interpolation direction and the 
calculated difference value associated with only one oblique interpolation direction 
are both within the threshold or where all three calculated difference values are 
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within the threshold, the selection logic 156 outputs the selected interpolation 
direction to the p calculator 108 as well as to the oblique upsampler 106. In the 
case where the calculated difference values associated with the two oblique 
directions are within the threshold, the values 01 AR and 01 AL and possibly 02 AR 
5 and 02 AL are used to determine which interpolation direction to output to the P 

calculator 108 and to the oblique upsampler 106. 

The source pixels shown in Figure 1 0 correspond to the source 
pixels used in interpolating in the bottom-right quadrant. These source pixels 
represent the "future" value of the differences. 

10 The p calculator 108 is best seen in Figure 1 1 and includes a 

multiplexer 1 60 which receives the a y and -Oy constants as well as the interpolation 
direction output by the selection logic 1 56. The multiplexer output is supplied to 
an adder 1 62 which also receives the a x constant. The output of the adder 1 62 
constitutes the p constant output of the p calculator 108. 

15 Figure 12 best illustrates the oblique upsampler 106 and as can be 

seen it comprises three linear interpolators 106a, 106b and 106c, although in 
principle higher order interpolations could be used. Each linear interpolator 
includes two adders and a multiplier. Two linear interpolators are used for 
directional interpolation and one for horizontal interpolation. The oblique 

20 upsampler also includes four multiplexers 165 to 168, which receive the sign of the 

P constant and four multiplexers 170 to 176, each of which receives the 
interpolation direction from the selection logic 156. Multiplexers 165 and 166 
provide output to multiplexer 170 and multiplexers 167 and 168 provide output to 
multiplexer 172. 

25 The source pixels input to multiplexers 165 to 168 and multiplexers 

174 to 176 illustrate the case for interpolating the bottom right quadrant. 
Multiplexers 170 and 172 provide output to linear interpolator 106a. Linear 
interpolator 106a includes an adder 178 receiving input from multiplexers 170 and 
172 which supplies input to a multiplier 180. The multiplier 180 which receives 

30 the a y constant provides input to another adder 1 82 which also receives input from 

multiplexer 172. 
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Similarly, multiplexers 174 and 176 provide output to linear 
interpolator 106b. Linear interpolator 106b includes an adder 184 receiving input 
from multiplexers 174 and 176 which supplies input to a multiplier 186. The 
multiplier 1 86 which receives the a y constant provides input to another adder 1 88 
which also receives input from multiplexer 176. 

The output of the two linear interpolators 106a and 106b respectively 
are supplied to linear interpolator 106c. Linear interpolator 106c includes an adder 
190 receiving input from the adders 182 and 188 which supplies input to multiplier 
192. The multiplier 192 receives the p constant from the p calculator 108 and 
supplies input to adder 194. Adder 194 also receives the output of adder 188 and 
generates as its output the value of the upsampled target pixel w. 

The input pixels and shifting of the multiplexers 174 and 176 are 
controlled so that the output of adder 188 represents intermediate pixel v, (i.e. the 
intermediate pixel closest to the reference pixel P R ). The input pixels and shifting 
of the multiplexers 165 to 168, 170 and 172 are controlled so that the output of 
adder 1 82 represents either intermediate pixel v 0 or intermediate pixel v 2 depending 
upon the position of the upsampled target pixel w on the intermediate line segment. 
The designators V, O r and O l input to multiplexers 170 to 176 in Figure 12 refer 
to the source pixels that are used to interpolate in the vertical, oblique right and 
oblique left directions respectively. 

The linear interpolator 106c constituted by adders 190 and 194 and 
multiplier 192 performs the calculation representing the non-orthogonal horizontal 
interpolation between the intermediate pixels. 

The following chart sets out the directional interpolations performed 
by the oblique upsampler 106 for all values of a x and Oy in order to generate the 
intermediate pixels v. The value of P for each interpolation direction is also 
included. 
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Interpolation 
Direction 


a y 


Intermediate 
Pixels 


p 


Vertical 


Oy^O 

ct<0 


Vo^i+Cu.riio.,)©, 
v,=n O o+(u l<r u 0 Ja y 

Vj^Uo.-KUn-Uo,)^ 

v 0 -u 0 .,+(u I . r u 0 . I )(-a y ) 

v i "oo V u .icr u ocA tt y 
Vj-Uo^Cu.H-UojX-Oty) 




Oblique Up-Left 


a y <0 


V I=«W + (U| 
Vz^Uot+CUjj-Uo,)^ 

v 0 ^i + (u.,. 2 -Uo.iX-a y ) 
v.^Ufm+fu i i -u^W-a. ) 

J *"00 \ -1-1 **00/V yJ 
V 2=U0! + («.|0-U0.X-Oy) 




Oblique Up-Right 


a y <0 


Vj^Uo^CUjo-Uo,)^ 

Vo^^-Ku.io-Uo.Ot-ay) 

v,=u 0 o+(u. I1 -u 00 X-a y ) 
v 2 = 5 u 0 ,+(u l2 -u 0I X-a y ) 





As one of skill in the art will appreciate, once the intermediate pixels 
v and the value of P are known, the upsampied target pixel w can be generated by 
horizontal interpolation using one of the following equations: 

w = V| +(v 2 - Vl ) P; P2>0 (20) 
w-v, +(v 0 - v.M-p); p<0 (21) 

Referring now to Figures 13 to 28, another embodiment of a method 
for generating upsampied target pixels using seven possible interpolation directions 
and a four-point interpolator will now be described. 

Similar to the previous embodiment, the input source data is 
examined to determine the closest source pixel to the upsampied target pixel w and 
that source pixel is used as a reference pixel P R . Source pixels from the two source 
lines above the upsampied target pixel, and the two source lines below the 
upsampied target pixel are determined (see block 2 1 0 in Figure 23a) and selected 
pixels of these source lines are compared to determine the interpolation direction to 
be selected when generating the upsampied target pixel. The source pixels are used 
to calculate difference values for six possible oblique directions (block 212). The 
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calculations vary depending upon the quadrant of interpolation and are shown in 
the following chart: 



Top-Left 


Top-Right 


Bottom-Left 


Bottom- 
Right 


Associated Interoolation Direction 


abs[U or U.,J 


ab S [U 00 -U.„] 


absfUoa-U,.,] 


abs[U or LU 


45° line up-right 




(1) 


abstlVU.,.,] 


abs[U 0l -U.J 


absfU^.-UJ 


absfUoo-U,,] 


45° line up-left 




(2) 


abstlWU.,,] 


absCUoo-U.J 


abslUotf-U.J 


absdJo.-U M ] 


26.6° line up-right-right 


"in* 


(3) 


abs[U (Kr U l .J 


abs[U 01 -U. 11 ] 


abs[U 0 .,-U„] 


abs[U <xr U l J 


26.6° line up-left-left 


O uu . 


(4) 


abs[U 1 .,.U. 10 J 


absfUoj-U,,] 


absfUarU,.,] 


abs[U. It -U ia ] 


63.4° line up-up-right 


"OUR 


(5) 


absIlVU.,.,] 


abs[U„-U. 1 J 


abs[U.,.,-UJ 




63.4° line up-up-left 




(6) 










vertical 


V 


(7) 



The interpolation directions O^, O^, O^, O^, CW, O^, and V 
are illustrated in Figure 13 for the top-left quadrant. No difference values are 
calculated for the vertical direction V shown. 

The calculations yield a set of difference values associated with each 
oblique interpolation direction. The set of difference values to the right of the 
reference pixel under consideration and the set of difference values to the left of the 
reference pixel are also used. The three sets of difference values are summed for each 
oblique interpolation direction yielding a 'Vorking" set of difference values. The 
difference values of this working set are compared with each other to determine the 
smallest differences within a threshold (blocks 2 1 4 and 2 1 6). If the smallest 
differences are sufficiently small to indicate low-frequency edges then they yield a set 
of possible interpolation directions. 

The possible interpolation directions are then examined to see if a 
"boundary crossing" situation occurs (blocks 21 8 and 220). Figure 14 demonstrates 
this situation. Here the up-left-left direction representing a white line joining pixels 
Uqo and U. N , is being considered, however there is a dark grey "boundary" joining 
pixels Uq., and U. M . Selecting the up-left-left direction would cross the boundary, 
and therefore the up-left-left direction can not be considered. This situation is 
detected by examining differences B, and B 2 . 

The possible interpolation directions are then examined and a single 
interpolation direction is selected (block 222). Block 222 is expanded in Figure 23b. 
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If only one oblique interpolation direction is possible then that direction is chosen 
(blocks 230 and 232). If no low-frequency edges are detected then the vertical 
interpolation direction is chosen as default (blocks 238 and 240). If both a leftward 
and a rightward oblique interpolation direction are possible, then the vertical direction 
is again chosen as default (blocks 248 and 250). 

Otherwise only either rightward or leftward oblique interpolation 
directions are under consideration. If only one of the "extreme" directions (either 
26.6° or 63.4 ° obliques) and the 45 ° oblique direction are possible then that extreme 
direction is chosen (blocks 252 and 254). Otherwise both extremes are possible and 
the "middle" direction (the 45° oblique) is chosen (block 256). 

Once the interpolation direction is chosen, the pixels required for the 
directional interpolation must be determined (block 224). The source data is then 
directionally interpolated to generate the intermediate pixels (block 226). Finally the 
intermediate pixels are interpolated horizontally to generate the desired upsampled 
target pixel w (block 228). 

The location of the upsampled target pixel w, is defined by its 
distances from the reference pixel P R both in the x and y directions. These distances 
are represented by the terms a„ and a y where: 

-0.5<a x *0.5; and 

-0.5<a y *0.5; 

a x being positive to the right and a y being positive downward. 

In this embodiment, a four-point "filter" interpolator is used. 
Interpolated upsampled target pixels w are calculated as a function of four source 
pixels, S 0 , S,, S 2 and S 3 , and a parameter a representing the distance of the desired 
pixel from S,: 

w = /(S 0 ,S„S 2 , S 3 , a) 
This function may be a four-tap filter with coefficients read from a ROM indexed by 
parameter a. 

Figure 1 5 shows the case when the vertical interpolation direction V is 
selected. The target pixel w is positioned in the "Top-Left" quadrant with a x and a 
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both negative. The intermediate horizontal line segment represented by the values Vj, 
is determined by vertical four-point interpolation as follows: 

v 0 ■ /(U 3 . 2 , U 0 . 2 , U.,. 2f U 22 , -<x y ) 

v,=/(U M ,U 0 . I ,U. M ,U. 2 . h -o y ) 

v 2 = /(U 10 , Uoo, U -l0 , U. 20 , -a y ) 

V3-/(U, It U 0 itU.,i,U 4l> ^ r ) 

v 4 = /(U 12 , U 02 , U. 12 , U. 22 , -a y ) 

After the five intermediate pixels are calculated, interpolations are 
performed on these pixels to calculate the value of the desired upsampled target pixel. 
The distance p, representing the horizontal distance from the target pixel w to the 
middle intermediate pixel, v 2 must first be calculated. The calculation of p for the 
other three quadrants is also shown in Figure 15. In the vertical direction case, p is 
simply equal to a x for all quadrants. In the case of Figure 1 5, upsampled target pixel 
w is in the Top-Left quadrant and p is negative. Thus, the upsampled target pixel is 
represented by: 

w-/(v„ v 2 ,v„ v 0 , ~P) 
In the other quadrants around the reference pixel P R , the upsampled target pixel w can 
be similarly calculated. 

When the oblique up-right direction is selected, the intermediate 
pixels are interpolated along positively sloped 45 ° diagonals. Figure 1 6 shows the 
up-right case. The target pixel w, is positioned in the Top-Right quadrant with a x 
positive and Oy negative. Using four-point interpolation along the indicated diagonals 
yields: 

v 0 = /(U JO , U 0 . 2 , U. M , U. 20 , -a y ) 
v, - /(U ,. 2 , Uo.,, U. I0 , U. 2h -a y ) 
v 2 = /(U m . U M , U., „ U. 22 , -a y ) 
v 3 = /(U l0 , U 0 „ U I2 , U. 23 , -cty) 
v 4 = /(U„, U 02 , U.,3, U 24 , -a y ) 

After the five intermediate pixels have been computed non-orthogonal, 
horizontal interpolation is performed to determine the upsampled target pixel w. 
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Since the interpolation is on a 45 ° angle, the horizontal distance from the reference 
pixel P R to intermediate pixel v 2 is simply the vertical distance, namely, -a y . Thus, P 
is simply a x + a y . In the present case, P is positive so the upsampled target pixel is 
represented by: 

w = /(v„v 2 ,v 3 , v 4 ,P) 
For other quadrants, a similar method may be used to determine the upsampled target 
pixel. The intermediate pixels used and P vary from quadrant to quadrant. Figure 1 6 
also demonstrates the calculation of p for each quadrant. These results are 
summarized in Table A below. 

Interpolating in the oblique up-left direction is very similar to the 
up-right direction. Intermediate pixels are interpolated along negatively sloped 45 ° 
diagonals. In Figure 1 7, the upsampled target pixel w is in the Bottom-Right quadrant 
with both a x and Oy positive. Using four-point interpolation along the diagonals: 

v 0 - /(U.,.3, U M , U„, Ujo, Oy) 

v i = /(U.,.2, U Wf U 10 , U 2I , a y ) 

v 2 = /(U. M ,Uoo,U n ,U 22 , a y ) 

v 3 = /OJ.io» U 0 „U, 2> U 23 , a y ) 

V4 = /(U.„,U 02 ,U 13 , U 24 , Oy) 

The upsampled target pixel is computed by performing non- 
orthogonal, horizontal interpolation on the intermediate pixels. Again, since the 
interpolation is along a 45° diagonal, the horizontal distances to the intermediate 
pixels are equal to the vertical distances. For the Bottom-Right quadrant, p = <x x - a r 
With P positive, the upsampled target pixel is represented by: 

w-/(v„ v 2 ,v 3 , v 4 , P) 
Again a similar method applies for the other quadrants with P varying from quadrant 
to quadrant. Figure 1 7 demonstrates the calculation of P for the other quadrants with 
the results in Table A. 

When the oblique up-right-right (O mK ) or up-left-left (O^) 
interpolation directions are selected, interpolation is along the 26.6° diagonals. The 
source pixels/diagonals used for four-point interpolation are shown for both the up- 
right-right and up-left-left directions in Figure 18. 
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Figure 19 shows some of the source pixels used in up-right-right 
interpolation for an upsampled target pixel w in the Bottom-Left quadrant, with a x 
negative and a y positive. Using four-point interpolation along the positively sloped 
26.6° diagonals: 

v 0 = /(U l0 , Uo_ 2 , U M , U 2-6 , a y ) 

v J =/(U, 1> U 0 . h U,.3, U 2 . 5 , a y ) 

V 2 " /0J., 2 , Uoo, U U2 , U 2 ^, Oy) 

v 3 = /(U_ J3 ,U 01 ,U M ,U 2 . 3 ,a y ) 
v 4 =/(U. l4 , U 02 ,U IO , U 2 . 2 a y ) 

The upsampled target pixel is calculated by horizontal interpolation. 
Since interpolation is along the 26.6° diagonals, horizontal distances to the 
intermediate pixels are twice the vertical distance. For the Bottom-Left quadrant p = 
2a y - (-a x ) « a x + 2ay. With p positive, the upsampled target pixel is represented by: 

w = /(v„v 2 ,v 3 , v 4 , p) 
Similarly for other quadrants. Figure 19 shows the calculation of p for other 
quadrants as summarized in Table A. 

When the up-left-left interpolation direction is selected for 
interpolation, intermediate pixels are interpolated along negatively sloped 26,6° 
diagonals. Some of the source pixels used are shown in Figure 20 for the Top-Left 
quadrant with both <x x and a y negative. Using four-point interpolation: 

v 0 - /(U l0 , U M , U. M> U. 26 , -Oy) 

v, - /(U,„ U w , U.,.3, U. 2 . 5 , -oty) 

v 2 = /(U, 2 , Uoo, U-w. U_ w , -cty) 

v 3 = /(U, 3 , U 0I , U. Mf U. 2 . 3 , -Oy) 

v 4 = /(U,4, U 02 , U., 0> U. 2 . 2 , -a y ) 

Again since interpolation is along 26.6° diagonals, the horizontal 
distance to the intermediate pixels is equal to twice the vertical. For the Top-Left 
quadrant p - -2a y - (-a x ) = a x - 2a y . With p positive, the upsampled target pixel is 
represented by: 

w = /(v„ v 2 ,v 3 , v 4l P) 
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A similar method applies for the other quadrant with varying p. Figure 20 
demonstrates the calculation of P for other quadrants. The results are summarized in 
Table A. 

When either the oblique up-up-right (0^) or up-up-left (O^) 
interpolation directions are selected, the directional interpolation involves 
interpolating across more source lines than in the previous cases. To avoid requiring 
too many source lines, linear interpolation is used for directional interpolation for the 
up-up-right and up-up-left directions. 

Figure 21 illustrates the interpolations required for the up-up-right, 
CW> interpolation direction. The upsampled target pixel w, is in the Bottom-Right 
quadrant with both a x and a y positive. Interpolation is along positively sloped, 63.4° 
diagonals. There are two types of these offsetting diagonals, namely the "inside" and 
"outside" diagonals as represented by the lines U M U_ 10 and U^U^, respectively. The 
linear upsampling parameter for the outside diagonal is given by the vertical distance 
a y from the intermediate pixel to the source pixel. Since interpolation skips a source 
line, the linear upsampling parameter is halved, i.e. (Xy/2. Similarly for the inside 
diagonal, the parameter is (l-a y )/2. Using linear interpolation, the intermediate pixels 
are calculated as follows: 

v 0 = (l-0.5(l-a y ))U M + 0.5(l-a y )U_ I0 

v, = (1- O.Sa^Uoo + 0.5a y U 2 _, 

v 2 = (l-0.5(l-a y ))U lo + 0.5(l-a y )U. n 

v 3 = (1- 0.5a y )U 01 + 0.5a y U 20 

v 4 = (1 -0.5(1 -a y ))U n + 0.5(l-a y )U. J2 

The upsampled target pixel is calculated by non-orthogonal horizontal 
interpolation. Four-point interpolation is still used horizontally. Since interpolation 
is along the 63.4° diagonals, horizontal distances to the intermediate pixels are half 
the vertical distance. Additionally, since the spacing between intermediate pixels is 
half the spacing for the previous interpolation directions, p is twice the distance from 
the centre intermediate pixel to the target pixel. For the Bottom-Right quadrant 0.5 = 
a x -0.5 p + 0.5a y . So p = -1 + 2a x + a r With p negative, the upsampled target pixel is 
represented by: 
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W = /(V 3 , V 2 ,V t , Vg, -P) 

Similarly for other quadrants. Figure 2 1 shows the calculation of P for other 
quadrants as summarized in Table A. 

For the oblique up-up-left O^, interpolation direction shown in 
Figure 22 the upsampled target pixel w, is in the Top-Right quadrant with a x positive 
and cty negative. Interpolation is along the negatively sloped 63.4° diagonals. The 
linear upsampling parameter for the inside diagonal is (1 + a y )/2 and the parameter for 
the outside diagonals is -a/2. Once again using linear interpolation: 

v 0 - (1 -0.5(1 +a y ))U. M + 0.5(l+a y )U 10 

v, = (l-aSC-OyWUoo + O^JU*, 

v 2 = (1-0.5(1 +a y ))U. l0 + 0.5(1 +6gU n 

v 3 = (l-0.5(-a y ))U 01 + 0.5(-a y )U. 20 

v 4 =(l-0.5(l+a y ))U. II + 0.5(l+a y )U I2 



Four-point horizontal interpolation is performed on the intermediate 
pixels. Once again the horizontal distances to the intermediate pixels are half the 
vertical distances, and p is twice the distance from the centre intermediate pixel to the 
target pixel. For the case of the upsampled target pixel w being in the Top-Right 
quadrant, p = 2(cc x + (-0.5a y ) - 1 ) = -1 + 2a x - a y . Since p is positive, the upsampled 
target pixel is represented by: 

w = /(v l ,v 2 ,v 3 ,v 4 , p) 
A similar method applies for the other quadrants. Figure 22 shows the calculation of 
P for other quadrants as summarized in Table A. 

Figure 24 shows a basic source data interpolation apparatus 300 for 
performing the above method. As can be seen, apparatus 300 is the same as the 
apparatus used in the first embodiment. The same block diagram applies to the 
second embodiment just described. Source data D in is passed through a delay circuit 
302 which extracts the necessary source pixels required for interpolation. These 
source pixels are used by the decision circuit 304 to select an interpolation direction. 
The selected interpolation direction is passed to the p calculator 308 to determine the 
value of p. The source pixels, interpolation direction, and P are all passed to the 
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oblique upsampler 306 for directional interpolation to generate the upsampled target 
pixel w. 

Figure 25 better illustrates the delay circuit 302 of the present 
embodiment. It includes three line stores 344, 370, and 396 which give access to four 
consecutive source lines and forty-eight delay elements 320 to 342, 346 to 368, 372 to 
394, and 398 to 420 which in turn give access to thirteen adjacent source pixels on 
each of the four source lines. The delay circuit extracts the 1 3x4 source matrix 
needed for interpolation. When interpolating in the upper quadrants, the pixels 
extracted correspond to the source pixels labelled. 

The decision circuit 304 is better illustrated in Figure 26. Input source 
pixels are fed to six subtracters 446, 452, 458, 464, 470, and 476. Each subtracter 
calculates a difference value corresponding to one of the six possible oblique 
directions. Two delay elements for each difference value 448, 450, 454, 456, 460, 
462, 466, 468, 472, 474, 478, and 480 provide access to three consecutive difference 
values for each direction. These difference values are passed to a selection means 
482 which selects either one of the six possible oblique interpolation directions or the 
vertical interpolation direction. The source pixels labelled correspond to interpolation 
in the top-left quadrant 

The P calculator shown in Figure 27 comprises a three input adder 
508. The adder inputs are the outputs of three multiplexers 502, 504, and 506. The 
output of multiplexer 502 is 0, 1, or -1 depending on the output of decoder 500 which 
takes the interpolation direction selected and the quadrant of the upsampled target 
pixel. Multiplexer 504 outputs either a x or 2a x depending on the interpolation 
direction selected. Finally multiplexer 506 outputs either <x y , -a y , 2a y , or -2a y 
depending also on the interpolation direction. The output of adder 508 is p. 

The oblique upsampler 306 is best illustrated in Figure 28. It 
comprises three main parts; namely an input decoder 532, a directional interpolator 
306a and a horizontal interpolator 306b. The input source pixels are decoded in the 
input decoder 532 according to the quadrant in which the upsampled target pixel is 
located and the interpolation direction. The required source pixels are sent to the 
directional interpolator 306a which performs four 4-point interpolations to generate 
four intermediate pixels. The 4-point directional interpolation is performed by four 4- 
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tap filters 534, 536, 538, and 540 whose coefficients are supplied from a ROM, 530, 
addressed by |a y |. The four intermediate pixels are passed to the 4-point horizontal 
interpolator 306b to calculate the upsampled target pixel w. The horizontal 
interpolator 306b is composed of a 4-tap filter 544 and a ROM, 542, addressed by p. 
5 Table A below outlines the directional interpolations performed to 

generate the intermediate pixels for each of the seven interpolation directions. The 
Table also includes the formula for calculating (J for the various directions and 
quadrants. 



TABLE A 



Interpolation 
Direction 


Quadrant 


Intermediate Pixels 

V W V " V 21 V 3l V 4 


P 


Vertical 
V 


Top-Left 
a x <0, a y <0 


v 0 = /(U ,. 2 , U 0 _ 2 , U.,^, U. 2 . 2 , -a y ) 
v, - /(U Mf U 0 .,, U. M , U. 2 .„ -a y ) 
v 2 = /(U ,o, Uoo, U. J0 , U. 20 , -« y ) 
v, = /rtJif Uaw U U., -a) 

V 4 = /(U I2 , U 02 , U.,2, U. 22 , -«y) 


a. 




Top-Right 
a x *0, a y <0 


V 0 = /(U ,. 2 , Uo.2, U.,.2, U.2.2, -S> 

v, = /(U,.„ Uo.lU.,.,, U. 2 .„ -a y ) 
v 2 " /(U, 0 , Uoo, U. I0 , U.20, -a y ) 
v 3 = /(U,„ U 0 „ U.„, U. 2 „ -a,) 

V 4 » /(U, 2 , U 02 , U.,2, U.22, "Oy) 


a* 




Bottom-Left 
a x <0, a y z0 


v 0 = /(U.,.2, U 0 . 2> U,.,, U 2 . 2 , a y ) 
v i =/(U.,.„ Uo.„ U,.„ U 2 .„ a y ) 

v 2 = /(U.,o, Uoo, U,o, U 20 , a y ) 
v 3 = /(U.,„ U 0 „ U,„ U2,, a y ) 
v 4 - /(U.,2, Uoz, U, 2 , U 22 , a y ) 


a* 




Bottom-Right 
a x ^0, Oy*0 


V 0 - /(U.,.2, U0.2, U,. 2 , U 2 . 2 , Oy) 

v, =/(U.,.„ U 0 .„ U,.„ U 2 .„ a y ) 
v 2 = /(U.,o, Uoo, U, 0 , U 20 , a y ) 
v 3 =/(U., l ,U OI) U,„U2„o y ) 
v 4 - /(U.,2, U 02 , U, 2 , U 22 , a y ) 
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Up-Right 


Top-Left 
ct x <0, a y <0 


v o = /(U M) U 0 .„ U.,. 2 , U. 2 .„ -a y ) 
v, = /(U,.j, Uo. 2 , U.,.„ U. 20 , -« y ) 
v 2 = /(U..2, Uo.,, U.,o, U. 2I , -a y ) 
v 3 = /(U ,.„ Uoo, U., „ U.2,, -a y ) 

v = f{\ I TT TT TI «\ 

v 4 /w,o, u 0 i, u.,2, u.23, -a y ; 


l+a x +a y 
a x +a y 




Top-Right 
a^O, a y <0 


V 0 = /(U,. 3 , Uo.2, U.,.„ U.20, -Oy) 

V l = /(U,.2, Uo.,, U.,o, U. 2 „ -a,) 

v : - /(U,.„ Uoo, U.,„ U.J,, -a y ) 
v 3 = /(U, 0 , U 0 „ U.,2, U.23, -a y > 

xi — /n 1 IT TT TT 

v 4 - /(u,„ U 02 , U.,3, U.24, -a y ) 






Bottom-Left 
a x <0, a y *0 


v 0 = /(U.,.„ Uo.2, U,. 3 , U 2 ^, a y ) 
v, = /(U.,o, Uo.,, U,.2, U 2 .j, a y ) 
v 2 - /(U.„, Uoo, U,.„ U M , a y ) 
v 3 - /(U.,2, U 0 „ U,o, U 2 .„a y ) 
V4 = /(U.,3, U 02 , U,„ U20, a,) 


l+a x +a y 




Bottom-Right 
a x *0, a y i0 


v 0 " /(U.,o, U 0 .„ U,. 2 , U 2 . 3 , a y ) 
v, = /(U.„, Uoo, U,.„ U 2 .2, a,) 

V 2 = /(U.,2, U 0 „ U |0 , U 2 .„ Oy) 

v 3 = /(U.,3, U 02 , U„, U20, a y ) 
v 4 - /(U., 4 , U 03 , U n , U 2 „ a y ) 
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Up-Left 


I Top-Left 
cc x <0, cc^O 


v 0 = /(U M , U^, U.,.j, U. 2Jl , -a,) 
v i = /(U J0 , Uo.„ U.,.2, U.2.3, -a v ) 
v 2 = /(U, „ Uoo, U.,.„ U.2.2, -a y ) 
v 3 = /(U,2, U 0I , U. 10 , U. 2 .„ -a y ) 
v 4 = /(U 13 , U 02 , U.,„ U.,0, -a v ) 

1 "f </ \ I J' w "II* "aU* y y 


a x -a y 
-l+a x - 




Top-Right 
<x x ;»0, a y <0 


v 0 = /(U, 0 , Uo.„ U.,.2, U.2.3, -a y > 

V, = /(U,„ U M , U.,.„ U 2 .2, "Oy) 

v 2 = /(U,2, U 0 „ U.,o, U. 2 .„ -a y ) 
v 3 - /(U,j, U 02 , U.„, U.20, -a y ) 
v 4 = /(U, 4 , U 0 i, U „, U ,„ -a ) 


l+a x -a y 




Bottom-Left 

a x <0, a y <t0 


v 0 = /(U. M , U0.3, U,.2, U2.„ a y ) 
v, = /(U.,.3, Uo.2, U,.„ U20, a y ) 
/(U.,.2, Uo.„ U,o,U 2 „a y ) 
V3 = /(U.,.„Uoo,U,„U2 2 ,a y ) 
v 4 - /(U., 0 , U 0 „ U,2, U 23 , Oy) 


a x -a y 




Bottom-Right 
a x :>0, ctyiO 


v 0 - /(U.,.3, U0.2, U,.„ U 20 , a,) 
V|- /(U.,.2, Uo.,, U, 0 , U 2 „ a y ) 
V2 = /(U.,.„Uoo,U,„U22,a y ) 
V3 = /(U. I0 , U 0 „U,2, U 23 ,a y ) 
v 4 = /(U.,„ U TO , U l3 , U 24 , a y ) 
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Up-Right-Right 


Top-Left 
<x x <0, a y <0 


v o - /(U,. s , Uo.3, U.,.„ U. 2I) -a y ) 
v, - /(U M , U 0 . 2 , U.,o, U. 22 , -o y ) 
v 2 = /(U l .3,Uo.„U.,„U. 23 ,-a v ) 
v 3 - /(U,. 2 , Uoo, U. I2 , U. 24 , -a,) 
v 4 = /(U,.„ U 0 „ U.,3, U.2j, -a y ) 


l+a x +2 

a y 




Top-Right 
a x *0, a y <0 


v 0 = /(U M , Uo. 2 , U.,o, U.22, -a y ) 
V| = /(U,. 3 , U 0 .„ U.,„ U.23, -a y > 

V 2 = /(U,. 2 , Uoo, U.,2, U.24, -Oy) 

v 3 = /(U,.„ U 0 „ U.,j, U.25, -a y ) 

V 4 " /(U |0 , U 02 , U.,4, U.26, -a,) 


a x +2a y 




Bottom-Left 

a x <0, oty^O 


v 0 = /(U.,o, Uo.2, U M , U 2 ^, a y ) 
v, = /(U.,„ Uo.,, U,.j, U 2 . 5 , a y ) 

v 2 = /(U.,2, Uoo, U,. 2 , U 2J( , Oy) 

v 3 = /(U.,3, U 01 , U M , U 2 .3, a y ) 

V* = f(U ,a. Um, Uin. U, aJ) 
4 y v *, 4, w u2, w io, w 2 -2* yJ 


l+a x +2 




Bottom-Right 
a x 2>0, ety^O 


v 0 = /(U „, U 0 .„ U,. 3 , U 2 .„ oty) 
v, = /(U.,2, Uoo, U,. 2 , U 2 ^, a y ) 
v 2 = /(U.,3, U 0 „ U,.„ U 2 . 3 , a y ) 
v 3 = /(U.,4, U 02> U, 0 , U 2 . 2 , a y ) 
V4 = /(U.,5, U 03 , U„, U 2 .„ a y ) 
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Up-Left-Left 


Top-Left 


v o - /(U,o, Uo. 2 , U.m, U.2^5, -a y ) 


/-» 




a x <0, a y <0 


Vi - /(U,„ Uo.,, U.,.3, U.2.5, -« y ) 






v 2 - /(U, 2 , Uoo, U.,. 2 , U.2^, -a y ) 

. . — X C\ T TT IT IT u \ 

v 3 ~ /(U,3, U 0 „ U.,.„ U.2.3, -« y ) 
v< = /(U, 4 , U 02 , U.,o, U.2.2, -a y ) 


X 




Top-Right 


v 0 ■ /(U, „ Uo.,, U.,.3, U.2.5, -a y ) 

V| = /(U,j, Uoo, U.,.2, U.2^, -Oty) 
V 2 = /(U, 3 , U 0 „ U.,.„ U.2.3, "Oy) 
V 3 - /(U u , U 02 , U.,o, U.j.2, -«y) 


2a v 




a x *0, 0,0 








v 4 = /(U, 5 , U 03 , U.,,, U. 2 .„ -a v ) 


l+a x - 






2a y 




Bottom-Left 


v 0 = /(U.,.5, U0.3, U,.„ U 2 „ a,) 






a x <0, Oy^O 


f /T T 1 f T y TT V 

v, - /(U. M , U 02 , U, 0 , U 22 , a,,) 
v 2 - /(U.,.3, Uo.,, U„, U 23 , Oy) 
v 3 = /(U.,.2, Uoo, U, 2 , U 24 , a y ) 
v 4 ■ /(U.,.„ U 0 „ U, 3 , U 2S , a y ) 


a x -2a y 




Bottom-Right 


v 0 = /(U. M , U 0 .2, U, 0 , U 22 , a y ) 






a x ^0, a y *0 


v. = /(U.,.3, Uo.,, U,„ U 23 , a y ) 






v 2 - /(U.,.2, Uoo, U, 2 , U J4 , a y ) 
v 3 = /(U.,.„ U 0 „ U, 3 , U 2S , a y ) 
V4 = /(U.,o, U 02 , U M , U 26 , a y ) 





WO 97/17801 PCT/CA96/00703 



- 32 - 



Up-Up-Right 

Ouur 


Top-Left 

cc x <0, a y <0 


v 0 - u.,_, + (u,. 2 - u.^xo-s+ascg 

v, = U 0 ., + (U. 20 - Uo.,X-0.5a y ) 
v 2 = U.,o + (U M - U. IO X0.5+0.5a y ) 
v 3 = U 00 + (U. 21 - Uoo)(-0.5a y ) 
v 4 U-i i ' v.u,o - u.,,;(u.->+u.5a y ) 


1 +2a x + 
a 

y 




Top-Right 
a x 2>0, a y <0 


v 0 = Uo., + (U. 20 - U0..X-0.5O,) 
v, = U.,o + (U M - U. lo X0.5+0.5a y ) 
v 2 = Uoo + (U. 21 -U 00 X-0.5a y ) 
v 3 - U.„ + (U,o - U.nXO.S+O.Sa,) 
v « - U 0I + (U 22 - U 0 ,X-0.5a y ) 


2a x +a y 




Bottom-Left 
a x <0, OySO 


v 0 - Uo., + (U 2 . 2 - Uo.,X0.5a y ) 
v 1 =U 1 . l + (U.,o-U ) .,X0.5-0.5a y ) 
v 2 - U„o + (U 2 ., - Uoo)(0.5a y ) 
V3 = U l0 + (U.„-U, 0 X0.5-0.5a y ) 
v 4 = U 0J + (U 20 - U 0 ,X0.5a y ) 


2a x +a y 




Bottom-Right 


v 0 - U,., + (U.,o - U,.,X0.5-0.5a y ) 
v, = Uoo + (U 2 ., -UooX0.5a y ) 
v 2 = U 10 + (U.„ - U.oXO.S-O.SOy) 
v 3 = U 0 , + (U 20 - U 01 )(0.5a y ) 
v 4 = U n + (U. l2 -U„X0.5-0.5a y ) 


1 +2a x + 
a y 
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Up-Up-Left 


Top-Left 
a x <0, a y <0 


v 0 = U o . l +(U. 2 . 2 -Uc)(-0.5a y ) 
v, = U. w + (U,o - U. M X0.5+0.5^) 
v 2 = U M + (U. 2 ., - U M X-0.5a y ) 
v, = U. IO + (U ll -U. IO X0.5+0.5a y ) 
V 4 = Uor + (U , n - UmX-0.5a„) 


2a x -a y 




Top-Right 
a x i0, a y <0 


v 0 = U,., + (U, 0 - U. M X0.5+0.5cv) 
v, - Uoo + (U. 2 ., - UooX-0.5a y ) 
v 2 - U.,o + (U„ - U. 10 X0.5+0.5a y ) 
v 3 - U 0 , + (U.20 - U 0 ,X-0.5a y ) 
v 4 = U „ + (U„ - U ,,X0.5+0.5a ) 


-l+2a x - 




Bottom-Left 
a x <0, cty^O 


vo = U,., + (U.,.2 - U.^XO-S-CSa,) 
v 1 = U CM +(U2o-U 0 . 1 )(0.5a y ) 

v 2 = U,o + (U.m - U, 0 )(0.5-0.5a y ) 

v 3 - Uoo + (U 2 , - U M X0.5a y ) 

v 4 = U,., + (U.,o - U,.,)(0.5-0.5a y ) 


1 +2a x - 
a v 




Bottom-Right 
a x a0, Oy^O 


v 0 = Uo. 1 +(U 20 -Uo. 1 X0.5a y ) 
v, = U,o + (U.,., - U, 0 X0.5-0.5a y ) 
v 2 = Uoo + (U 2 , - UooXO-SOy) 
v 3 = U 1 . 1 +(U. 10 -U l .,X0.5-0.Sa y ) 
v, = U 0 , + (U 22 - U 01 )(0.5o y ) 


2a x -a y 



As mentioned previously, once the intermediate pixels are generated 
four-point horizontal interpolation is performed on the intermediate pixels to generate 
the desired upsampled target pixel w. 

w = /(v„ v 2 ,v 3 , v 4 ,p) p*0 

w = f(v 3 ,v 2 , v„ v 0 ,-P) p<0 



The present methods and apparatuses allow upsampled target pixels to 
be generated so that when an image of the source data is to be enlarged and recreated, 
the resolution of the enlarged image is high and stairstepping is minimized. 

As should be apparent to those of skill in the art, various modifications 
may be made to the present invention without departing from its scope as defined by 
the appended claims. For example, although two embodiments of the invention have 
been described herein, it should be apparent that other embodiments are possible and 
that the number of oblique directions in each set can be chosen arbitrarily. 
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WHAT IS CLAIMED IS : 



1 . A method of generating an upsampled target pixel from input source 
data comprising the steps of: 

(i) comparing pixels of different lines of said source data in a region 
surrounding an upsampled target pixel to be generated in at least two different 
directions; 

(ii) selecting an interpolation direction based on the comparisons of step 

0); 

(iii) interpolating between selected pixels of different lines of said source 
data in the interpolation direction determined at step (ii) and computing intermediate 
pixels on a line segment passing through said upsampled target pixel; and 

(iv) interpolating between the intermediate pixels to generate said 
upsampled target pixel. 

2. The method of claim 1 wherein said line segment is parallel to the lines 
of said source data. 



3. The method of claim 2 wherein at step (i), pixels of different lines of 
said source data are compared in at least three different directions. 

4. The method of claim 3 wherein at step (i) pixels of different lines of 
said source data are compared in only three different directions, said three different 
directions including a vertical direction, and opposite oblique directions forming an 
angle with said vertical direction, said angle being in the range 0<angle<90°, the 
pixels of said source data being compared in each of said oblique directions being 
located on opposite sides of said upsampled target pixel. 

5. The method of claim 4 wherein during the comparisons of step (i), 
difference values between the compared pixels are generated, the difference values 
being used at step (ii) to select the interpolation direction. 
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6. The method of claim 5 wherein prior to step (ii), the difference values 
resulting from the comparisons in said three directions are compared to determine 
whether the differences therebetween are within a threshold, the interpolation 
direction associated with the smallest difference value being selected when none of 
the differences are within the threshold, the selection of said interpolation direction at 
step (ii) being influenced when the difference between at least two difference values 
is within the threshold. 

7. The method of claim 6 wherein at step (ii), when the differences 
between the difference values resulting from the comparisons in all three directions 
are within said threshold, the vertical interpolation direction is selected at step (ii). 

8. The method of claim 7 wherein when the difference between the 
difference values resulting from the comparisons in the vertical direction and only one 
of the oblique directions is within the threshold, that oblique interpolation direction is 
selected at step (ii). 

9. The method of claim 8 wherein when the difference between the 
difference values resulting from the comparisons in the two oblique directions is 
within the threshold, additional pixels of the different lines of source data are 
compared in the opposite oblique directions, the pixels of said source data being 
compared in each of said oblique directions being located on opposite sides of said 
upsampled target pixel, the difference values generated as a result of these 
comparisons being compared to influence the selection of said interpolation direction 
at step (ii). 

1 0. The method of claim 9 wherein when the difference between the 
difference values resulting from the comparisons of the additional pixels is within the 
threshold, the vertical interpolation direction is selected at step (ii). 

1 1 . The method of claim 4 wherein during step (i), the pixels of the 
different lines of source data are examined to determine the closest pixel to said 
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upsampled target pixel and wherein said region is defined by consecutive pixels in 
two lines of source data that form the comers of a rectangular region surrounding said 
upsampled target pixel, one of the pixels of which is said closest pixel, said oblique 
directions forming a 45° angle with said vertical direction and constituting diagonals 
5 of said rectangular region. 

12. The method of claim 1 1 wherein during the comparisons of step (i), 
difference values between the compared pixels are generated, the difference values 
being used at step (ii) to select the interpolation direction. 

13. The method of claim 12 wherein prior to step (ii), the difference values 
1 0 resulting from the comparisons in said three directions are compared to determine 

whether the differences therebetween are within a threshold, the interpolation 
direction associated with the smallest difference value being selected when none of 
the differences are within the threshold, the selection of said interpolation direction at 
step (ii) being influenced when the difference between at least two difference values 
15 is within the threshold. 

1 4. The method of claim 1 3 wherein at step (ii), when the differences 
between the difference values resulting from the comparisons in all three interpolation 
directions are within said threshold, the vertical interpolation direction is selected at 
step (ii). 

20 15. The method of claim 1 4 wherein when the difference between the 

difference values resulting from the comparisons in the vertical direction and only one 
of the oblique directions is within the threshold, that oblique interpolation direction is 
selected at step (ii). 

1 6. The method of claim 1 5 wherein when the difference between the 

25 difference values resulting from the comparisons in the two oblique directions is 

within the threshold, additional pixels of the different lines of source data are 
compared in the opposite oblique directions, the difference values generated as a 
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result of these comparisons being compared to influence the selection of said 
interpolation direction at step (ii). 

1 7. The method of claim 1 6 wherein the difference between the difference 
values resulting from the comparisons of the additional pixels is within the threshold, 
the vertical interpolation direction is selected at step (ii). 

1 8. The method of claim 3 wherein at step (i), pixels of different lines of 
said source data are compared in at least seven different directions. 

1 9. The method of claim 1 8 wherein at step (i) pixels of said source data 
are compared in only seven different directions, said seven different directions 
including a vertical direction and two sets of opposite oblique directions forming an 
angle with said vertical direction, said angle being in the range of 0<angle<90°, each 
set of opposite oblique directions including three oblique directions, each forming a 
different angle with said vertical direction, the pixels of the source data being 
compared in each set of oblique directions, being located on opposite sides of said 
upsampled target pixel. 

20. The method of claim 1 9 wherein one of the oblique directions in each 
set forms a 26.6° angle with the vertical direction, another of the oblique direction in 
each set forms a 63.4° angle with the vertical direction and another of the oblique 
directions in each set forms a 45 ° angle with said vertical direction. 

2 1 . The method of claim 20 wherein during the comparisons of step (i), 
difference values between the compared pixels are generated, the difference values 
being used at step (ii) to select the interpolation direction. 

22. The method of claim 2 1 wherein the difference values generated 
during comparisons in said oblique directions in each set are summed to yield a 
working difference value, the working difference values and the difference value 
associated with said vertical direction being compared to determine whether the 
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differences therebetween are within a threshold, the interpolation directions 
associated with the difference values within the threshold yielding a set of possible 
interpolation directions, the interpolation directions in said set being initially 
examined to eliminate interpolation directions which interpolate between pixels in a 
direction that cross a boundary, the remaining interpolation directions being 
compared further at step (ii) to select said interpolation direction. 

23. The method of claim 22 wherein after interpolation directions which 
cross a boundary have been eliminated, at step (ii) if only one oblique interpolation 
direction remains in said set then that interpolation direction is selected, if opposite 
oblique interpolation directions remain in said set then said vertical interpolation is 
selected and if more than one oblique interpolation direction in the same direction 
exists in the set then the 45° oblique interpolation direction is selected. 

24. The method of claim 23 wherein at step (iii) interpolations between 
selected pixels on four different lines of said source data are made in the selected 
interpolation direction to yield five intermediate pixels. 

25. An apparatus for generating an upsampled target pixel from input 
source data comprising: 

comparison means for comparing pixels of different lines of said 
source data in a region surrounding an upsampled target pixel, in at least two different 
directions; 

selection means for selecting an interpolation direction in response to 
said comparison means; and 

upsampling means for interpolating between selected pixels of 
different lines of said source data in the interpolation direction selected by said 
selection means to compute intermediate pixels on a line segment passing through 
said upsampled target pixel and for interpolating between the intermediate pixels to 
generate said upsampled target pixel. 
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26. An apparatus as defined in claim 25 wherein said upsampling means 
computes pixels on a line segment parallel to the lines of said source data. 

27. An apparatus as defined in claim 26 wherein said comparison means 
compares pixels of different lines of said source data in at least three different 
directions. 

28. An apparatus as defined in claim 27 wherein said comparison means 
compares the pixels of different lines of said source data in a vertical direction and in 
opposite oblique directions forming an angle with said vertical direction, said angle 
being in the range 0<angle<90°. 

29. An apparatus as defined in claim 28 wherein said comparison means 
generates a difference value for each of said three comparisons and wherein said 
selection means compares the difference values with one another to determine 
whether the differences therebetween are within a threshold, said selection means 
selecting the interpolation direction associated with the smallest difference value 
when none of the differences are within the threshold. 

30. An apparatus as defined in claim 29 wherein said selection means 
selects the vertical interpolation direction when the differences between the all of the 
difference values are within said threshold. 

31. An apparatus as defined in claim 30 wherein when the difference 
between the difference values in the vertical direction and only one of the oblique 
directions is within the threshold, the selection means selects that oblique 
interpolation. 

32. An apparatus as defined in claim 3 1 wherein when the difference 
between the difference values in the two oblique directions is within the threshold, 
additional pixels of the different lines of source data are compared in the opposite 
oblique directions by the comparison means, the difference values generated as a 
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result of these comparisons being compared by said selection means, when the 
difference between the difference values generated by the selection means as a result 
of the comparison of the additional pixels is within the threshold, the vertical 
interpolation direction is selected by said selection means. 

33. An apparatus as defined in claim 29 further comprising means to 
determine the closest pixel of said source data to said upsampled target pixel and the 
consecutive pixels in two lines of said source data that form the corners of a 
rectangular region surrounding said upsampled target pixel, one of the pixels of which 
is said closest pixel, said comparison means being responsive to said determination 
means and comparing between the pixels that define said rectangular region. 

34. An apparatus as defined in claim 27 wherein said comparison means 
compares pixels of different lines of said source data in at least seven different 
directions. 

35. An apparatus as defined in claim 34 wherein said comparison means 
compares pixels of different lines of said source data in seven different directions, 
said seven different directions including a vertical direction and two sets of opposite 
oblique directions forming angles with said vertical direction, each set of opposite 
oblique directions including three oblique directions, each of said three oblique 
directions forming a different angle with said vertical direction, the compared pixels 
in each set of three oblique directions being located on opposite sides of said 
upsampled target pixel. 

36. An apparatus as defined in claim 35 wherein said comparison means 
compares pixels in oblique directions forming 26.6°, 45° and 63.4° angles with said 
vertical direction. 

37. An apparatus as defined in claim 25 wherein said upsampling means 
includes a directional interpolator for computing said intermediate pixels and a 
second interpolator for computing said upsampled target pixel. 
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38. An apparatus as defined in claim 37 wherein each of said linear 
interpolators includes a pair of adders and a multiplier. 

39. An apparatus as defined in claim 35 wherein said comparison means 
includes a plurality of substractors, each substractor being associated with one of said 
oblique directions. 

40. An apparatus as defined in claim 37 wherein said upsampling means 
includes a pair of linear interpolators for computing said intermediate pixels and a 
third linear interpolation for computing said upsampled target pixel. 

41. An apparatus as defined in claim 40 wherein said directional 
interpolator includes a plurality of polyphase filters, each of said polyphase filters 
receiving coefficients from a memory. 

42. An apparatus as defined in claim 41 wherein said second interpolator 
includes a polyphase filter receiving coefficients from a second memory. 

43. An apparatus as defined in claim 36 wherein said comparison means 
generates a difference value for each of said seven comparisons, the difference values 
for said oblique directions in each set being summed to yield a working difference 
value. 

44. An apparatus as defined in claim 43 wherein said selection means 
compares the working difference values and the difference value associated with the 
vertical direction with one another to determine whether the differences therebetween 
are within a threshold, said selection means selecting a set of possible interpolation 
directions associated with the smallest difference value when none of the differences 
are within the threshold, the interpolation directions in said set being initially 
examined to eliminate interpolation directions which interpolate between pixels in a 
direction that crosses a boundary. 
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45. An apparatus as defined in claim 44 wherein said selection means 

selects the vertical interpolation direction when opposite oblique interpolation 
directions remain in the set of possible interpolation directions. 



5 



46. An apparatus as defined in claim 45 wherein if only one oblique 

interpolation direction remains in the set of possible interpolation directions, the 
selection means selects that oblique interpolation direction. 
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